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MPEG DECODER OF IMAGES FROM MULTIPLE SEQUENCES 

TECHNICAL FIELD 

The present invention relates to circuits for decoding images coded 
according to standard MPEG, and more specifically to a circuit for controlling an MPEG 
5 decoder likely to decode a plurality of images in a reduced time, for example one vertical 
scanning period of a television screen, to visualize several television channels at the same 
time. 

BACKGROUND OF THE INVENTION 

Coding standard MPEG enables storing the images of a digital image 
10 sequence in a reduced memory space, or transmitting these images in a channel of reduced 
flow. A coded image must be decoded before being able to be displayed, for example on a 
television screen. 

Fig. 1 schematically shows in the form of blocks the main elements of a 
device 2 for decoding and displaying digital image sequences coded according to standard 

15 MPEG. This device includes a decoder (DECOD) 4 connected via a bus 6 to a memory 
(MEM) 8 in which the coded images to be decoded are stored. The images decoded by the 
decoder are temporarily stored in memory 8, before being provided to a screen (SCRN) 10 
connected to bus 6 via a display control and management device (DIS) 12. The decoder 
and the display controller are controlled by a circuit such as a microprocessor (|uP) 14 

20 connected via a bus 7 to provide and receive control signals and data. Microprocessor 14 
especially provides the decoder with orders for decoding the coded images stored in 
memory 8. Conventionally, to order the decoding of coded image stored in an area of 
memory 8, microprocessor 14 provides decoder 4 with the address of the beginning of this 
area, and with the image decoding order starting from a given time. The operation of such 

25 a circuit is well known by those skilled in the art and it will not be detailed any further. 

Existing analog television systems conventionally provide displaying 
several images on screen upon a same screen scanning. This for example enables 
displaying one or several images incrusted in a main image and simultaneously visualizing 
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several television channels. There is a need for a device for decoding images coded 
according to standard MPEG enabling such a simultaneous display, that is, enabling 
decoding of a plurality of images within a period of vertical scanning of a television screen. 

The device of Fig. 1 enables decoding and displaying the images of a single 

5 image sequence. Thus, a solution consists of duplicating this device as many times as 
simultaneously decoded and displayed images are desired. 

It is conventional in a television system to divide an image in two interlaced 
frames and to display each of the two frames upon two successive vertical screen 
scannings. According to standard MPEG, an image can be coded in three different ways: 

10 either in the form of a complete image including the two interlaced frames ("frame" 
image), or in the form of two half-images, each of which corresponds to one of the frames 
("field" images), or else in the form of a non-interlaced complete image ("progressive" 
image). The following description only relates to interlaced images of both types, since 
progressive images can, in a known manner, be processed in the same way as the interlaced 

15 half-images. A same image sequence may be formed of images corresponding to both 
coding types. The different image sequences that are desired to be decoded and 
simultaneously displayed may also have different codings. The decoding of each type of 
coded image corresponds to a specific operation of decoder 4. 

Fig. 2A illustrates the decoding of a sequence of two images Ii and I4, each 

20 coded in the form of two half-images In and Iib, and I4T and I4B respectively. The frame 
contained in each decoded half-image must be displayed in a period Tvsync, and a half- 
image can thus be decoded in a period Tvsync. Decoder 4 receives from microprocessor 14 
the order to decode half-images Iix, Iib, L^t, I4B, respectively at times tioo, tioo, hoo and t4oo, 
each distant by a period Tvsync. The respective decodings of half-images In, lie, Uy, Ub 

25 occur in the period Tvsync immediately following the decoding order. It should be noted 
that, to ensure a proper operation of the decoding and display device, it is desirable for the 
decoding of a half-image to be no longer than a maximum duration equal to one period 
Tvsync and not to continue in the following period. 

Fig. 2B illustrates the decoding of a sequence of two images h and I5 coded 

30 in the form of complete images. The two frames included in a complete decoded images 
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must be displayed during two consecutive periods Tvsync, and a complete image can be 
decoded in two periods Tvsync- Decoder 4 receives from microprocessor 14 the order to 
decode complete images I2 and I5 respectively at times tioo and tsoo- The respective 
decodings of images h and I5 occur during the two successive periods Tvsync that 

5 immediately follow the decoding order. In this case also, to ensure a proper operation, it is 
desirable for the decoding not to be continued after the end of the maximum duration, here 
of two periods, which is assigned thereto. It should be noted that memory 8 is a buffer that 
only contains a few images of a sequence, which are written and read in phase with the 
reception of the sequence by the decoding and display device. When several image 

10 sequences coming from different sources are considered, it is possible for these sequences 
not to be in phase, in terms of periods Tvsync, and for them to have to be decoded and 
displayed with this phase shift. Especially, two image sequences coded in the form of 
complete images may be shifted by one screen seaming period Tvsync- 

Fig. 2C illustrates the decoding of a sequence formed of two images I3 and 

15 l6 coded in the form of complete images, the decoding order of which is given to decoder 4 
with a phase shift of one period Tvsync with respect to the sequence of Fig. 2B. The order 
to decode images I3 and is given to the decoder at times t2oo and t4oo, and their respective 
decodings occur during the two successive periods Tvsync that immediately follow the 
decoding order. 

20 Considering a circuit enabling simultaneous decoding and display of three 

image sequences such as those of the preceding drawings, which uses three distinct devices 
such as that in Fig. 1, each of these devices can decode with its own phase the image 
sequence provided thereto. Such a circuit operates satisfactorily, but has several 
disadvantages. In particular, it uses three MPEG decoders, which are large, bulky and 

25 expensive circuits. 

SUMMARY OF THE INVENTION 

An embodiment of the present invention provides a device, which only 
includes a single decoding circuit, for decoding several images. 
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The device includes a specific control circuit to manage the decoding of 
images from several sequences, of different types of coding and phase, by means of a 
single decoder. 

In particular, the control circuit controls an MPEG decoder rated by a signal 
5 of given period likely to decode several coded images, receiving at each period beginning 
an order to decode several images of a first or of a second type, the images of the second 
type being decodable at any instant of the period following their decoding order, and the 
images of the first type being decodable at any instant of the two periods following their 
decoding order, including a priority assignment circuit for, at each period, granting among 
10 these images the decoding priority, if there are any, to the images of the first type that still 
have not been decoded one period after their decoding order and otherwise, if there are any, 
to the images of the second type. 

According to an embodiment of the present invention, the control circuit 
further includes a pointer memory for storing the beginning addresses of each of the images 
15 to be displayed. 

According to an embodiment of the present invention, the control circuit 
further includes a safety circuit for adding a predetermined header before each image 
provided to the decoder so that two images put end to end cannot form a code that causes a 
malfimction of the decoder. 
20 An embodiment of the present invention includes an integrated control 

decoding circuit including an MPEG decoder connected to such a control circuit. 

Another embodiment of the present invention includes a circuit for decoding 
and displaying images coded according to standard MPEG, including such an integrated 
control decoding circuit connected to read coded data fi-om and to write decoded data into a 
25 memory via a first bus, a display control circuit connected between a screen and the first 
bus, and a microprocessor connected to a second bus, to control the integrated control 
decoding circuit and the display control circuit. 

According to an embodiment of the present invention, the images of the first 
type are interlaced complete images, and the images of the second type are interlaced half- 
30 images. 
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According to an embodiment of the present invention, the images of the first 
type are interlaced complete images, and the images of the second type are interlaced half- 
images or non-interlaced complete images. 

The foregoing features and advantages of the present invention will be 
5 discussed in detail in the following non-limiting description of specific embodiments in 
connection with the accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1, previously described, shows in the form of blocks a device according 
to prior art for decoding and displaying a sequence of images coded according to standard 
10 MPEG; 

Figs. 2A, 2B, 2C, previously described, illustrate the decoding according to 
prior art of three image sequences having different types of coding and phase; 

Fig. 3 illustrates, in the form of blocks, an embodiment of a decoding and 
display device according to the present invention; 
15 Fig. 4 shows, in the form of blocks, an embodiment of the control circuit of 

Fig. 3; 

Figs. 5 and 6 illustrate the operation of the circuit of Fig. 3; and 
Fig. 7 shows, in the form of blocks, an embodiment of the integrated control 
decoding circuit of Fig. 3. 



20 DETAILED DESCRIPTION OF THE INVENTION 

Same references designate same elements in the different drawings. For 
clarity, only those elements useful to the understanding of the present invention have been 
shown. 

Fig. 3 shows in the form of blocks a decoding and display device 16 
25 according to the present invention, which enables processing the images of several distinct 
sequences, for example three, in one screen scanning period. Device 16 includes an 
integrated control decoding circuit (COMDEC) 18 connected to read the coded data of 
three sequences and to write the decoded data into a memory 8 via a bus 6. A display 
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control circuit (DIS) 20 has its output connected to a screen 10. The input of circuit 20 is 
connected to bus 6 to read from memory 8 the decoded images of the three sequences and 
to transmit them to screen 10. It should be noted that display control circuit 20 is more 
complex than circuit 12 of Fig. 1 and that it is in particular able to have access in the 

5 memory to the data of several images and to display them adequately on screen. As in 
Fig. 1, the general device is driven by a microprocessor 14 via a bus 7. Integrated control 
decoding circuit 18 includes a decoding circuit 4 identical to the decoder of Fig. 1, and a 
circuit (COM) 24 for controlling the decoder circuit. It should be noted that, for the device 
according to the present invention to operate, decoder 4 must operate at a rate at least three 

10 times greater than the rate described in relation with Figs. 2A to 2C, that is, it must be able 
to decode in two periods Tvsync three complete images or six half-images, or any 
equivalent combination. This condition is fulfilled by most decoders according to the state 
of the art, and it is not limiting in practice. The order in which the images are decoded 
during these two periods is particularly important and control circuit 24 has the function of 

15 determining which images are to be decoded in priority. Control circuit 24 also has the 
function of ensuring the compatibility of the data provided to decoder 4 with the MPEG 
syntax. 

Fig. 4 shows in the form of blocks an embodiment of control circuit 24 
according to the present invention. Circuit 24 includes an address pointer memory (ADP) 

20 26, for example formed of registers, connected to bus 7 to receive from microprocessor 14 
the beginning addresses (or pointers) of the areas of memory 8 in which the images to be 
decoded and the decoding parameters of these images are stored. The decoding parameters 
are especially used to identify the type of the images to be decoded. There are as many sets 
of parameters and of memory pointers as there are sequences to be decoded in parallel. 

25 Memory 26 is connected to decoder 4 to provide it with the addresses (or pointers) which 
the decoder must have to access memory 8, via bus 6, to perform its task. Finally, control 
circuit 24 includes a priority assignment circuit 30 connected to memory 26 to receive the 
decoding parameters associated with each image to be decoded. Circuit 30 is further 
connected to decoder 4 in order to enable the decoder to read from memory 8 images 

30 designated by the pointers of registers 26 with a priority order which will be described, and 
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to control decoding circuit 4 so that it decodes the images provided by memory 8. It should 
be noted that once the decoding parameters have been taken into account by the control 
circuit, the content of the registers of block 26 can be renewed by a following image. 

The operation of circuits 4 and 24 is synchronized on vertical scanning 
5 period Tvsync? and a new decoding order can be given by microprocessor 14 for each 
period. For each new period Tvsync? circuit 30 calculates a new priority order for the 
image decoding, the pointer and identification parameters of which have just been written 
into memory 26. According to the type of coding of the images having their pointer in 
memory 26, and also to the time from which each pointer is present therein, priority 

10 management circuit 30 assigns a priority to each pointer, after which it orders decoder 4 to 
decode the images designated by the pointers having the highest priority. According to the 
present invention, the highest decoding priority is granted to the complete images having 
had their pointer present in memory 26 for a duration longer than one period Tvsync? that 
is, complete images with a decoding order older than more than one period Tvsync- A 

15 lower decoding priority is granted to the half-images, and the lowest decoding priority is 
granted to the complete images having had their pointer present in memory 26 for less than 
one period Tvsync- This operation is illustrated in Figs. 5 and 6. 

Fig. 5 illustrates the decoding of two half-images Iit, Iib, the decoding order 
of which is given at times tioo and t2oo, and of two complete images I2 and I3, the decoding 

20 order of which is given at time tioo- The pointers and parameters of images Iit, h and I3 are 
written into memory 26 before time tioo? and the pointer of image Iib is written before time 
t2oo- Priority management circuit 30 grants the highest decoding priority to half-image In, 
and a low decoding priority level to images I2 and I3. Half-image Iit is decoded in priority, 
between time tioo and a time tiss located at one third of interval tioo-t2oo5 after which one of 

25 the two images I2, 13, for example image I2, is decoded between time ti33 and time t2oo- At 
time t2005 memory 26 thus contains the pointers of half-image Iib and of complete image I3. 
The pointer of image I3 has been in memory 26 for more than one period Tvsync? and 
circuit 30 assigns it with the highest decoding priority. Half-image Im receives the lowest 
priority. Image I3 is decoded between time t2oo and a time t266 located at the two thirds of 

30 interval t2oo-t3oo. Half-image Iib is decoded between time t266 and time tsoo- It should be 



7 



noted that the device 16 also enables decoding within two periods Tvsync: two images 
coded in the form of half-images and one complete image, only images coded in the form 
of half-images, or only images coded in the form of complete images. Other more complex 
decoding combinations may also be processed by the device. 

5 Fig. 6 illustrates a complex decoding combination in which the decoding 

order of two half-images Iit and Iib is given at times tioo and t2oo, the decoding order of two 
complete images h and I3 is given at time taoo? the decoding order of two half-images I4T 
and I4B is given at times tsoo and t4oo, and the decoding order of a complete image I5 is given 
at time tsoo- At time tioo? memory 26 only contains the pointer of half-image In, which is 

10 decoded between time tioo and time t^s. At time t2oo, memory 26 contains the pointers of 
half-image Iib and of complete images h and I3. The priority management circuit assigns 
the highest decoding priority to half-image Iib, which is decoded between times tioo and 
T233. Both complete images h and I3 then have a low decoding priority and one of them, 
for example, image I2, is decoded between times t233 and Uoo- At time tsoo. memory 26 

15 contains the pointers of half-image I4T and of complete images I3 and I5. The pointer of 
complete image I3 having been in memory 26 for more than one period Tvsync, the priority 
management circuit graats the highest decoding priority to complete image I3. A lower 
decoding priority is granted to half-image I4T, and the lowest decoding priority is granted to 
complete image I5. Complete image I3 is decoded between time t^oo and a time t366, located 

20 at two thirds of interval t3oo-t4oo, and half-image I4T is decoded between time t366 and time 
t4oo. At time t4oo, memory 26 contains the pointers of complete image I5 and of half-image 
I4B, and the decoding priority is granted to complete image I5. Image I5 is decoded between 
time t4oo and a time t466, and half-image I4B is decoded between time t466 and time tsoo- 

It should be noted that the priority management according to the present 

25 invention enables always decoding a half-image within the period Tvsync following its 
decoding order, and always decoding a complete image within the two periods Tvsync 
following its decoding order. 

In the device 16, decoder 4 consecutively receives the image data to be 
decoded from different image sequences, read from memory 8. It has been seen previously 

30 that decoder 4 is a conventional MPEG decoder. In such a decoder, the structure of which 
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will not be detailed herein, the decoding of an image ends when the decoder detects a code 
(PSC) marking the beginning of the next image. This code is defined by standard MPEG. 
Thus, decoder 4 reads from memory 8 the image that it decodes until it detects the PSC 
code of the next image stored in memory 8, Such an image, conventionally the next image 

5 in the sequence to which the decoded image belongs, is different from the next image to be 
decoded, the pointer of which is located in memory 26. Now, a conventional MPEG 
decoder includes an internal buffer area in which are permanently contained part of the data 
of the decoded image. Upon detection of the PSC code indicating the end of the decoding 
of an image, this memory area includes the last data of the decoded image as well as 

10 parasitic data corresponding to the PSC code and to the first data of the next image in the 
sequence. This memory area cannot be reset, whereby decoder 4 receives these parasitic 
data before receiving the data of the next image to be decoded. These data start with a PSC 
code that triggers the next decoding. 

The putting end to end of the parasitic data and of the PSC code of the next 

15 image to be decoded is likely to take the form of a PSC code. For example, if the PSC 
codes correspond to a specific sequence of eight bytes respectively having values 00, 00, 
00, 00, 00, 01, 00, and 00, and if the parasitic data end with six bytes respectively having 
values 00, 00, 00, 00, 00, and 01, the putting end to end of the parasitic data and of the PSC 
code of the next image will be byte sequence 00 00 00 00 00 01 00 00 00 00 00 01 00 00 

20 and the decoder will identify the first eight bytes of this expression as being a PSC code. 
In such a case, the decoding of the next image will start too soon and the decoder will enter 
an erroneous operating mode. The present invention provides interposing, between the end 
of the parasitic data and the PSC code of the next image to be decoded, a safety header 
suppressing any risk of erroneous generation of a PSC code by the putting end to end of the 

25 parasitic data and of the next PSC code. The safety header may be formed of a coded byte 
at value FF. In the preceding example, the putting end to end of the parasitic data, of the 
safety header, and of the PSC code is a byte sequence 

00 00 00 00 00 01 FF 00 00 00 00 00 01 00 00 
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that presents no risk of erroneous identification of the PSC code. 

Fig. 7 shows in the form of blocks a circuit 18 such as described in Fig. 4, 
including a decoder 4 and a control circuit 24, further provided with a circuit 32 intended 
for inserting a safety header and for accessing to the image data instead of decoder 4, 
5 according to the addresses provided by memory 26. Circuit 32 is connected between bus 6 
and decoder 4. It is further connected to a decoding control output provided by circuit 30, 
to insert the header before the data provided to decoder 4 fi:om bus 6 at the beginning of 
each decoding. 

Of course, the present invention is Ukely to have various alterations, 

10 modifications, and improvements which will readily occur to those skilled in the art. In 
particular, those skilled in the art will easily adapt the present invention to a priority 
management circuit that grants the highest priority to the half-images, then to the complete 
images, the beginning address of which has been contained in memory 26 for more than 
one period Tvsync, then to the complete images, the beginning address of which has been 

15 contained in memory 26 for less than one period Tvsync. On the other hand, the case of a 
device enabling decoding and display of the images belonging to three different image 
sequences has been described, but those skilled in the art will easily adapt the present 
invention to a device enabling decoding and display of the images from two image 
sequences, jfrom four image sequences, or more. Cases in which each sequence includes 

20 images of a same type have only been described, but those skilled in the art will easily 
adapt the present invention to the case in which the sequences include images of different 
types. Finally, only the case in which all images have the same size and can be decoded 
within a same duration has been considered in the foregoing description. However, those 
skilled in the art will easily adapt the present invention to a case in which the images of the 

25 different sequences have different respective sizes (for example high and low resolutions), 
and where the decoding durations of the images fi*om each sequence are different. 

Such alterations, modifications, and improvements are intended to be part of 
this disclosure, and are intended to be within the spirit and the scope of the present 
invention. Accordingly, the foregoing description is by way of example only and is not 
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intended to be limiting. The present invention is limited only as defined in the following 
claims and the equivalents thereto. 
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